Pandas Profiling Report

Dataset statistics

Number of variables	18
Number of observations	844392
Missing cells	1809345
Missing cells (%)	11.9%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	122.4 MiB
Average record size in memory	152.0 B

Variable types

Numeric	9
DateTime	1
Categorical	8

Alerts

`Open` has constant value ""	Constant
`Sales` is highly overall correlated with `Customers`	High correlation
`Customers` is highly overall correlated with `Sales`	High correlation
`Promo2SinceWeek` is highly overall correlated with `Promo2` and 1 other fields	High correlation
`Promo2SinceYear` is highly overall correlated with `Promo2`	High correlation
`StoreType` is highly overall correlated with `Assortment`	High correlation
`Assortment` is highly overall correlated with `StoreType`	High correlation
`Promo2` is highly overall correlated with `Promo2SinceWeek` and 2 other fields	High correlation
`PromoInterval` is highly overall correlated with `Promo2SinceWeek` and 1 other fields	High correlation
`StateHoliday` is highly imbalanced (99.3%)	Imbalance
`CompetitionOpenSinceMonth` has 268619 (31.8%) missing values	Missing
`CompetitionOpenSinceYear` has 268619 (31.8%) missing values	Missing
`Promo2SinceWeek` has 423307 (50.1%) missing values	Missing
`Promo2SinceYear` has 423307 (50.1%) missing values	Missing
`PromoInterval` has 423307 (50.1%) missing values	Missing

Reproduction

Analysis started	2023-10-16 12:17:17.358081
Analysis finished	2023-10-16 12:18:51.927215
Duration	1 minute and 34.57 seconds
Software version	ydata-profiling vv4.5.1
Download configuration	config.json

Store
Real number (ℝ)

Distinct	1115
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	558.42292

Minimum	1
Maximum	1115
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	1
5-th percentile	56
Q1	280
median	558
Q3	837
95-th percentile	1060
Maximum	1115
Range	1114
Interquartile range (IQR)	557

Descriptive statistics

Standard deviation	321.73191
Coefficient of variation (CV)	0.57614382
Kurtosis	-1.1988414
Mean	558.42292
Median Absolute Deviation (MAD)	278
Skewness	0.00041375446
Sum	4.7152785 × 10⁸
Variance	103511.42
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
562	942	0.1%
769	942	0.1%
733	942	0.1%
423	942	0.1%
85	942	0.1%
262	942	0.1%
335	942	0.1%
682	942	0.1%
1097	942	0.1%
494	942	0.1%
Other values (1105)	834972	98.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	781	0.1%
2	784	0.1%
3	779	0.1%
4	784	0.1%
5	779	0.1%
6	780	0.1%
7	786	0.1%
8	784	0.1%
9	779	0.1%
10	784	0.1%

Value	Count	Frequency (%)
1115	781	0.1%
1114	784	0.1%
1113	784	0.1%
1112	779	0.1%
1111	779	0.1%
1110	783	0.1%
1109	622	0.1%
1108	780	0.1%
1107	623	0.1%
1106	784	0.1%

DayOfWeek
Real number (ℝ)

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.5203614

Minimum	1
Maximum	7
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	3
Q3	5
95-th percentile	6
Maximum	7
Range	6
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1.7236892
Coefficient of variation (CV)	0.48963417
Kurtosis	-1.2593101
Mean	3.5203614
Median Absolute Deviation (MAD)	2
Skewness	0.01929954
Sum	2972565
Variance	2.9711045
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
6	144058	17.1%
2	143961	17.0%
3	141936	16.8%
5	138640	16.4%
1	137560	16.3%
4	134644	15.9%
7	3593	0.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	137560	16.3%
2	143961	17.0%
3	141936	16.8%
4	134644	15.9%
5	138640	16.4%
6	144058	17.1%
7	3593	0.4%

Value	Count	Frequency (%)
7	3593	0.4%
6	144058	17.1%
5	138640	16.4%
4	134644	15.9%
3	141936	16.8%
2	143961	17.0%
1	137560	16.3%

Date
Date

Distinct	942
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

Minimum	2013-01-01 00:00:00
Maximum	2015-07-31 00:00:00

Histogram

Histogram with fixed size bins (bins=50)

Sales
Real number (ℝ)

HIGH CORRELATION

Distinct	21734
Distinct (%)	2.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	6955.5143

Minimum	0
Maximum	41551
Zeros	54
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	3173
Q1	4859
median	6369
Q3	8360
95-th percentile	12668
Maximum	41551
Range	41551
Interquartile range (IQR)	3501

Descriptive statistics

Standard deviation	3104.2147
Coefficient of variation (CV)	0.44629549
Kurtosis	4.8520115
Mean	6955.5143
Median Absolute Deviation (MAD)	1694
Skewness	1.593922
Sum	5.8731806 × 10⁹
Variance	9636148.8
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
5674	215	< 0.1%
5558	197	< 0.1%
5483	196	< 0.1%
6049	195	< 0.1%
6214	195	< 0.1%
5723	194	< 0.1%
5449	192	< 0.1%
5489	191	< 0.1%
5140	191	< 0.1%
5041	190	< 0.1%
Other values (21724)	842436	99.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	54	< 0.1%
46	1	< 0.1%
124	1	< 0.1%
133	1	< 0.1%
286	1	< 0.1%
297	1	< 0.1%
316	1	< 0.1%
416	1	< 0.1%
506	1	< 0.1%
520	1	< 0.1%

Value	Count	Frequency (%)
41551	1	< 0.1%
38722	1	< 0.1%
38484	1	< 0.1%
38367	1	< 0.1%
38037	1	< 0.1%
38025	1	< 0.1%
37646	1	< 0.1%
37403	1	< 0.1%
37376	1	< 0.1%
37122	1	< 0.1%

Customers
Real number (ℝ)

HIGH CORRELATION

Distinct	4086
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	762.7284

Minimum	0
Maximum	7388
Zeros	52
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	0
5-th percentile	349
Q1	519
median	676
Q3	893
95-th percentile	1440
Maximum	7388
Range	7388
Interquartile range (IQR)	374

Descriptive statistics

Standard deviation	401.22767
Coefficient of variation (CV)	0.52604266
Kurtosis	13.313755
Mean	762.7284
Median Absolute Deviation (MAD)	179
Skewness	2.7881104
Sum	6.4404176 × 10⁸
Variance	160983.65
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
560	2414	0.3%
576	2363	0.3%
603	2337	0.3%
571	2330	0.3%
555	2328	0.3%
566	2327	0.3%
517	2326	0.3%
539	2309	0.3%
651	2299	0.3%
533	2298	0.3%
Other values (4076)	821061	97.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	52	< 0.1%
3	1	< 0.1%
5	1	< 0.1%
8	1	< 0.1%
13	1	< 0.1%
18	1	< 0.1%
36	1	< 0.1%
40	1	< 0.1%
44	1	< 0.1%
50	1	< 0.1%

Value	Count	Frequency (%)
7388	1	< 0.1%
5494	1	< 0.1%
5458	1	< 0.1%
5387	1	< 0.1%
5297	1	< 0.1%
5192	1	< 0.1%
5152	1	< 0.1%
5145	1	< 0.1%
5132	1	< 0.1%
5112	1	< 0.1%

Open
Categorical

CONSTANT

Distinct	1
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

1	844392

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	844392
Distinct characters	1
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	1
3rd row	1
4th row	1
5th row	1

Common Values

Value	Count	Frequency (%)
1	844392	100.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
1	844392	100.0%

Most occurring characters

Value	Count	Frequency (%)
1	844392	100.0%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	844392	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	844392	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	844392	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	844392	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	844392	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	844392	100.0%

Promo
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

0	467496
1	376896

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	844392
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	1
3rd row	1
4th row	1
5th row	1

Common Values

Value	Count	Frequency (%)
0	467496	55.4%
1	376896	44.6%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
0	467496	55.4%
1	376896	44.6%

Most occurring characters

Value	Count	Frequency (%)
0	467496	55.4%
1	376896	44.6%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	844392	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	467496	55.4%
1	376896	44.6%

Most occurring scripts

Value	Count	Frequency (%)
Common	844392	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	467496	55.4%
1	376896	44.6%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	844392	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	467496	55.4%
1	376896	44.6%

StateHoliday
Categorical

IMBALANCE

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

0	843482
a	694
b	145
c	71

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	844392
Distinct characters	4
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	843482	99.9%
a	694	0.1%
b	145	< 0.1%
c	71	< 0.1%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
0	843482	99.9%
a	694	0.1%
b	145	< 0.1%
c	71	< 0.1%

Most occurring characters

Value	Count	Frequency (%)
0	843482	99.9%
a	694	0.1%
b	145	< 0.1%
c	71	< 0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	843482	99.9%
Lowercase Letter	910	0.1%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
a	694	76.3%
b	145	15.9%
c	71	7.8%

Decimal Number

Value	Count	Frequency (%)
0	843482	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	843482	99.9%
Latin	910	0.1%

Most frequent character per script

Latin

Value	Count	Frequency (%)
a	694	76.3%
b	145	15.9%
c	71	7.8%

Common

Value	Count	Frequency (%)
0	843482	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	844392	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	843482	99.9%
a	694	0.1%
b	145	< 0.1%
c	71	< 0.1%

SchoolHoliday
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

0	680935
1	163457

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	844392
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	1
3rd row	1
4th row	1
5th row	1

Common Values

Value	Count	Frequency (%)
0	680935	80.6%
1	163457	19.4%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
0	680935	80.6%
1	163457	19.4%

Most occurring characters

Value	Count	Frequency (%)
0	680935	80.6%
1	163457	19.4%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	844392	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	680935	80.6%
1	163457	19.4%

Most occurring scripts

Value	Count	Frequency (%)
Common	844392	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	680935	80.6%
1	163457	19.4%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	844392	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	680935	80.6%
1	163457	19.4%

StoreType
Categorical

HIGH CORRELATION

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

a	457077
d	258774
c	112978
b	15563

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	844392
Distinct characters	4
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	c
2nd row	a
3rd row	a
4th row	c
5th row	a

Common Values

Value	Count	Frequency (%)
a	457077	54.1%
d	258774	30.6%
c	112978	13.4%
b	15563	1.8%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
a	457077	54.1%
d	258774	30.6%
c	112978	13.4%
b	15563	1.8%

Most occurring characters

Value	Count	Frequency (%)
a	457077	54.1%
d	258774	30.6%
c	112978	13.4%
b	15563	1.8%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	844392	100.0%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
a	457077	54.1%
d	258774	30.6%
c	112978	13.4%
b	15563	1.8%

Most occurring scripts

Value	Count	Frequency (%)
Latin	844392	100.0%

Most frequent character per script

Latin

Value	Count	Frequency (%)
a	457077	54.1%
d	258774	30.6%
c	112978	13.4%
b	15563	1.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	844392	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
a	457077	54.1%
d	258774	30.6%
c	112978	13.4%
b	15563	1.8%

Assortment
Categorical

HIGH CORRELATION

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

a	444909
c	391271
b	8212

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	844392
Distinct characters	3
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	a
2nd row	a
3rd row	a
4th row	c
5th row	a

Common Values

Value	Count	Frequency (%)
a	444909	52.7%
c	391271	46.3%
b	8212	1.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
a	444909	52.7%
c	391271	46.3%
b	8212	1.0%

Most occurring characters

Value	Count	Frequency (%)
a	444909	52.7%
c	391271	46.3%
b	8212	1.0%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	844392	100.0%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
a	444909	52.7%
c	391271	46.3%
b	8212	1.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	844392	100.0%

Most frequent character per script

Latin

Value	Count	Frequency (%)
a	444909	52.7%
c	391271	46.3%
b	8212	1.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	844392	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
a	444909	52.7%
c	391271	46.3%
b	8212	1.0%

CompetitionDistance
Real number (ℝ)

Distinct	654
Distinct (%)	0.1%
Missing	2186
Missing (%)	0.3%
Infinite	0
Infinite (%)	0.0%
Mean	5457.9796

Minimum	20
Maximum	75860
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	20
5-th percentile	130
Q1	710
median	2320
Q3	6890
95-th percentile	20390
Maximum	75860
Range	75840
Interquartile range (IQR)	6180

Descriptive statistics

Standard deviation	7809.4373
Coefficient of variation (CV)	1.4308293
Kurtosis	13.413381
Mean	5457.9796
Median Absolute Deviation (MAD)	1970
Skewness	2.9751106
Sum	4.5967432 × 10⁹
Variance	60987311
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
250	9210	1.1%
50	6249	0.7%
350	6239	0.7%
1200	6072	0.7%
190	6066	0.7%
90	5609	0.7%
180	5422	0.6%
150	5294	0.6%
330	5294	0.6%
140	4684	0.6%
Other values (644)	782067	92.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
20	779	0.1%
30	3116	0.4%
40	3890	0.5%
50	6249	0.7%
60	2342	0.3%
70	3736	0.4%
80	2331	0.3%
90	5609	0.7%
100	3900	0.5%
110	4516	0.5%

Value	Count	Frequency (%)
75860	887	0.1%
58260	885	0.1%
48330	784	0.1%
46590	784	0.1%
45740	780	0.1%
44320	780	0.1%
40860	881	0.1%
40540	780	0.1%
38710	784	0.1%
38630	882	0.1%

CompetitionOpenSinceMonth
Real number (ℝ)

MISSING

Distinct	12
Distinct (%)	< 0.1%
Missing	268619
Missing (%)	31.8%
Infinite	0
Infinite (%)	0.0%
Mean	7.2248786

Minimum	1
Maximum	12
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	4
median	8
Q3	10
95-th percentile	12
Maximum	12
Range	11
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	3.2101438
Coefficient of variation (CV)	0.44431803
Kurtosis	-1.247663
Mean	7.2248786
Median Absolute Deviation (MAD)	3
Skewness	-0.17157646
Sum	4159890
Variance	10.305023
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
9	95467	11.3%
4	72256	8.6%
11	70032	8.3%
3	52685	6.2%
7	49009	5.8%
12	47887	5.7%
10	46198	5.5%
6	37759	4.5%
5	32862	3.9%
2	31360	3.7%
Other values (2)	40258	4.8%
(Missing)	268619	31.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	10297	1.2%
2	31360	3.7%
3	52685	6.2%
4	72256	8.6%
5	32862	3.9%
6	37759	4.5%
7	49009	5.8%
8	29961	3.5%
9	95467	11.3%
10	46198	5.5%

Value	Count	Frequency (%)
12	47887	5.7%
11	70032	8.3%
10	46198	5.5%
9	95467	11.3%
8	29961	3.5%
7	49009	5.8%
6	37759	4.5%
5	32862	3.9%
4	72256	8.6%
3	52685	6.2%

CompetitionOpenSinceYear
Real number (ℝ)

MISSING

Distinct	23
Distinct (%)	< 0.1%
Missing	268619
Missing (%)	31.8%
Infinite	0
Infinite (%)	0.0%
Mean	2008.6977

Minimum	1900
Maximum	2015
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	1900
5-th percentile	2001
Q1	2006
median	2010
Q3	2013
95-th percentile	2015
Maximum	2015
Range	115
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	5.9780481
Coefficient of variation (CV)	0.0029760815
Kurtosis	121.84638
Mean	2008.6977
Median Absolute Deviation (MAD)	3
Skewness	-7.5221054
Sum	1.1565539 × 10⁹
Variance	35.73706
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=23)

Value	Count	Frequency (%)
2013	63108	7.5%
2012	61719	7.3%
2014	52815	6.3%
2005	46705	5.5%
2010	42716	5.1%
2011	41366	4.9%
2009	40713	4.8%
2008	40198	4.8%
2007	36131	4.3%
2006	35543	4.2%
Other values (13)	114759	13.6%
(Missing)	268619	31.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1900	622	0.1%
1961	779	0.1%
1990	3887	0.5%
1994	1552	0.2%
1995	1404	0.2%
1998	766	0.1%
1999	6213	0.7%
2000	7631	0.9%
2001	12157	1.4%
2002	20736	2.5%

Value	Count	Frequency (%)
2015	28844	3.4%
2014	52815	6.3%
2013	63108	7.5%
2012	61719	7.3%
2011	41366	4.9%
2010	42716	5.1%
2009	40713	4.8%
2008	40198	4.8%
2007	36131	4.3%
2006	35543	4.2%

Promo2
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	12.9 MiB

0	423307
1	421085

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	844392
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	1
3rd row	1
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	423307	50.1%
1	421085	49.9%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
0	423307	50.1%
1	421085	49.9%

Most occurring characters

Value	Count	Frequency (%)
0	423307	50.1%
1	421085	49.9%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	844392	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	423307	50.1%
1	421085	49.9%

Most occurring scripts

Value	Count	Frequency (%)
Common	844392	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	423307	50.1%
1	421085	49.9%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	844392	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	423307	50.1%
1	421085	49.9%

Promo2SinceWeek
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	24
Distinct (%)	< 0.1%
Missing	423307
Missing (%)	50.1%
Infinite	0
Infinite (%)	0.0%
Mean	23.253426

Minimum	1
Maximum	50
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	13
median	22
Q3	37
95-th percentile	45
Maximum	50
Range	49
Interquartile range (IQR)	24

Descriptive statistics

Standard deviation	14.100569
Coefficient of variation (CV)	0.60638671
Kurtosis	-1.3690876
Mean	23.253426
Median Absolute Deviation (MAD)	13
Skewness	0.10641224
Sum	9791669
Variance	198.82603
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=24)

Value	Count	Frequency (%)
14	60541	7.2%
40	51507	6.1%
31	33238	3.9%
10	32214	3.8%
5	29722	3.5%
37	27116	3.2%
1	26873	3.2%
13	24579	2.9%
45	24072	2.9%
22	23645	2.8%
Other values (14)	87578	10.4%
(Missing)	423307	50.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	26873	3.2%
5	29722	3.5%
6	771	0.1%
9	10293	1.2%
10	32214	3.8%
13	24579	2.9%
14	60541	7.2%
18	22456	2.7%
22	23645	2.8%
23	3558	0.4%

Value	Count	Frequency (%)
50	780	0.1%
49	622	0.1%
48	7033	0.8%
45	24072	2.9%
44	2182	0.3%
40	51507	6.1%
39	3889	0.5%
37	27116	3.2%
36	7620	0.9%
35	18888	2.2%

Promo2SinceYear
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	7
Distinct (%)	< 0.1%
Missing	423307
Missing (%)	50.1%
Infinite	0
Infinite (%)	0.0%
Mean	2011.754

Minimum	2009
Maximum	2015
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	12.9 MiB

Quantile statistics

Minimum	2009
5-th percentile	2009
Q1	2011
median	2012
Q3	2013
95-th percentile	2014
Maximum	2015
Range	6
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.6609621
Coefficient of variation (CV)	0.00082562883
Kurtosis	-1.03757
Mean	2011.754
Median Absolute Deviation (MAD)	1
Skewness	-0.12274344
Sum	8.4711944 × 10⁸
Variance	2.7587952
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
2011	95040	11.3%
2013	91866	10.9%
2014	65768	7.8%
2012	60716	7.2%
2009	53826	6.4%
2010	46414	5.5%
2015	7455	0.9%
(Missing)	423307	50.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2009	53826	6.4%
2010	46414	5.5%
2011	95040	11.3%
2012	60716	7.2%
2013	91866	10.9%
2014	65768	7.8%
2015	7455	0.9%

Value	Count	Frequency (%)
2015	7455	0.9%
2014	65768	7.8%
2013	91866	10.9%
2012	60716	7.2%
2011	95040	11.3%
2010	46414	5.5%
2009	53826	6.4%

PromoInterval
Categorical

HIGH CORRELATION MISSING

Distinct	3
Distinct (%)	< 0.1%
Missing	423307
Missing (%)	50.1%
Memory size	12.9 MiB

Jan,Apr,Jul,Oct	242411
Feb,May,Aug,Nov	98005
Mar,Jun,Sept,Dec	80669

Length

Max length	16
Median length	15
Mean length	15.191574
Min length	15

Characters and Unicode

Total characters	6396944
Distinct characters	23
Distinct categories	3 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Jan,Apr,Jul,Oct
2nd row	Jan,Apr,Jul,Oct
3rd row	Jan,Apr,Jul,Oct
4th row	Jan,Apr,Jul,Oct
5th row	Feb,May,Aug,Nov

Common Values

Value	Count	Frequency (%)
Jan,Apr,Jul,Oct	242411	28.7%
Feb,May,Aug,Nov	98005	11.6%
Mar,Jun,Sept,Dec	80669	9.6%
(Missing)	423307	50.1%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
jan,apr,jul,oct	242411	57.6%
feb,may,aug,nov	98005	23.3%
mar,jun,sept,dec	80669	19.2%

Most occurring characters

Value	Count	Frequency (%)
,	1263255	19.7%
J	565491	8.8%
u	421085	6.6%
a	421085	6.6%
A	340416	5.3%
c	323080	5.1%
t	323080	5.1%
r	323080	5.1%
p	323080	5.1%
n	323080	5.1%
Other values (13)	1770212	27.7%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	3449349	53.9%
Uppercase Letter	1684340	26.3%
Other Punctuation	1263255	19.7%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
u	421085	12.2%
a	421085	12.2%
c	323080	9.4%
t	323080	9.4%
r	323080	9.4%
p	323080	9.4%
n	323080	9.4%
e	259343	7.5%
l	242411	7.0%
b	98005	2.8%
Other values (4)	392020	11.4%

Uppercase Letter

Value	Count	Frequency (%)
J	565491	33.6%
A	340416	20.2%
O	242411	14.4%
M	178674	10.6%
F	98005	5.8%
N	98005	5.8%
S	80669	4.8%
D	80669	4.8%

Other Punctuation

Value	Count	Frequency (%)
,	1263255	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	5133689	80.3%
Common	1263255	19.7%

Most frequent character per script

Latin

Value	Count	Frequency (%)
J	565491	11.0%
u	421085	8.2%
a	421085	8.2%
A	340416	6.6%
c	323080	6.3%
t	323080	6.3%
r	323080	6.3%
p	323080	6.3%
n	323080	6.3%
e	259343	5.1%
Other values (12)	1510869	29.4%

Common

Value	Count	Frequency (%)
,	1263255	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6396944	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
,	1263255	19.7%
J	565491	8.8%
u	421085	6.6%
a	421085	6.6%
A	340416	5.3%
c	323080	5.1%
t	323080	5.1%
r	323080	5.1%
p	323080	5.1%
n	323080	5.1%
Other values (13)	1770212	27.7%

Auto

Heatmap
Table

	Store	DayOfWeek	Sales	Customers	CompetitionDistance	CompetitionOpenSinceMonth	CompetitionOpenSinceYear	Promo2SinceWeek	Promo2SinceYear	Promo	StateHoliday	SchoolHoliday	StoreType	Assortment	Promo2	PromoInterval
Store	1.000	0.000	0.001	0.031	-0.046	-0.052	0.003	0.007	0.034	0.000	0.007	0.000	0.098	0.115	0.072	0.160
DayOfWeek	0.000	1.000	-0.179	-0.146	-0.000	0.000	0.001	-0.001	0.003	0.414	0.026	0.204	0.168	0.149	0.029	0.007
Sales	0.001	-0.179	1.000	0.832	-0.035	-0.042	0.055	0.097	-0.034	0.370	0.055	0.038	0.112	0.094	0.119	0.051
Customers	0.031	-0.146	0.832	1.000	-0.257	-0.032	0.054	0.038	0.045	0.208	0.067	0.023	0.328	0.272	0.207	0.048
CompetitionDistance	-0.046	-0.000	-0.035	-0.257	1.000	-0.034	-0.002	-0.020	-0.089	0.004	0.013	0.004	0.162	0.124	0.160	0.068
CompetitionOpenSinceMonth	-0.052	0.000	-0.042	-0.032	-0.034	1.000	-0.124	-0.039	0.045	0.000	0.010	0.000	0.120	0.105	0.156	0.192
CompetitionOpenSinceYear	0.003	0.001	0.055	0.054	-0.002	-0.124	1.000	-0.001	0.102	0.000	0.003	0.001	0.065	0.112	0.084	0.130
Promo2SinceWeek	0.007	-0.001	0.097	0.038	-0.020	-0.039	-0.001	1.000	-0.216	0.000	0.014	0.004	0.154	0.210	1.000	0.596
Promo2SinceYear	0.034	0.003	-0.034	0.045	-0.089	0.045	0.102	-0.216	1.000	0.000	0.012	0.006	0.127	0.193	1.000	0.301
Promo	0.000	0.414	0.370	0.208	0.004	0.000	0.000	0.000	0.000	1.000	0.011	0.029	0.018	0.013	0.000	0.000
StateHoliday	0.007	0.026	0.055	0.067	0.013	0.010	0.003	0.014	0.012	0.011	1.000	0.032	0.071	0.068	0.010	0.004
SchoolHoliday	0.000	0.204	0.038	0.023	0.004	0.000	0.001	0.004	0.006	0.029	0.032	1.000	0.005	0.004	0.008	0.000
StoreType	0.098	0.168	0.112	0.328	0.162	0.120	0.065	0.154	0.127	0.018	0.071	0.005	1.000	0.538	0.108	0.072
Assortment	0.115	0.149	0.094	0.272	0.124	0.105	0.112	0.210	0.193	0.013	0.068	0.004	0.538	1.000	0.016	0.086
Promo2	0.072	0.029	0.119	0.207	0.160	0.156	0.084	1.000	1.000	0.000	0.010	0.008	0.108	0.016	1.000	1.000
PromoInterval	0.160	0.007	0.051	0.048	0.068	0.192	0.130	0.596	0.301	0.000	0.004	0.000	0.072	0.086	1.000	1.000

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

First rows
Last rows

	Store	DayOfWeek	Date	Sales	Customers	Open	Promo	SchoolHoliday	StoreType	Assortment	CompetitionDistance	CompetitionOpenSinceMonth	CompetitionOpenSinceYear	Promo2	Promo2SinceWeek	Promo2SinceYear	PromoInterval
0	1	5	2015-07-31	5263	555	1	1	1	c	a	1270.0	9.0	2008.0	0	NaN	NaN	NaN
1	2	5	2015-07-31	6064	625	1	1	1	a	a	570.0	11.0	2007.0	1	13.0	2010.0	Jan,Apr,Jul,Oct
2	3	5	2015-07-31	8314	821	1	1	1	a	a	14130.0	12.0	2006.0	1	14.0	2011.0	Jan,Apr,Jul,Oct
3	4	5	2015-07-31	13995	1498	1	1	1	c	c	620.0	9.0	2009.0	0	NaN	NaN	NaN
4	5	5	2015-07-31	4822	559	1	1	1	a	a	29910.0	4.0	2015.0	0	NaN	NaN	NaN
5	6	5	2015-07-31	5651	589	1	1	1	a	a	310.0	12.0	2013.0	0	NaN	NaN	NaN
6	7	5	2015-07-31	15344	1414	1	1	1	a	c	24000.0	4.0	2013.0	0	NaN	NaN	NaN
7	8	5	2015-07-31	8492	833	1	1	1	a	a	7520.0	10.0	2014.0	0	NaN	NaN	NaN
8	9	5	2015-07-31	8565	687	1	1	1	a	c	2030.0	8.0	2000.0	0	NaN	NaN	NaN
9	10	5	2015-07-31	7185	681	1	1	1	a	a	3160.0	9.0	2009.0	0	NaN	NaN	NaN

	Store	DayOfWeek	Date	Sales	Customers	Open	StateHoliday	SchoolHoliday	StoreType	Assortment	CompetitionDistance	CompetitionOpenSinceMonth	CompetitionOpenSinceYear	Promo2	Promo2SinceWeek	Promo2SinceYear	PromoInterval
1016588	494	2	2013-01-01	3113	527	1	a	1	b	a	1260.0	6.0	2011.0	0	NaN	NaN	NaN
1016606	512	2	2013-01-01	2646	625	1	a	1	b	b	590.0	NaN	NaN	1	5.0	2013.0	Mar,Jun,Sept,Dec
1016624	530	2	2013-01-01	2907	532	1	a	1	a	c	18160.0	NaN	NaN	0	NaN	NaN	NaN
1016656	562	2	2013-01-01	8498	1675	1	a	1	b	c	1210.0	NaN	NaN	0	NaN	NaN	NaN
1016770	676	2	2013-01-01	3821	777	1	a	1	b	b	1410.0	9.0	2008.0	0	NaN	NaN	NaN
1016776	682	2	2013-01-01	3375	566	1	a	1	b	a	150.0	9.0	2006.0	0	NaN	NaN	NaN
1016827	733	2	2013-01-01	10765	2377	1	a	1	b	b	860.0	10.0	1999.0	0	NaN	NaN	NaN
1016863	769	2	2013-01-01	5035	1248	1	a	1	b	b	840.0	NaN	NaN	1	48.0	2012.0	Jan,Apr,Jul,Oct
1017042	948	2	2013-01-01	4491	1039	1	a	1	b	b	1430.0	NaN	NaN	0	NaN	NaN	NaN
1017190	1097	2	2013-01-01	5961	1405	1	a	1	b	b	720.0	3.0	2002.0	0	NaN	NaN	NaN

Overview

Variables

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Decimal Number

Most occurring scripts

Most frequent character per script

Latin

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Most occurring scripts

Most frequent character per script

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Most occurring scripts

Most frequent character per script

Latin

Most occurring blocks